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(54) Three-dimensional imaging by projecting morphologically filtered pixel data 



(57) In three-dimensional imaging of ultrasound da- 
ta, speckle artifact data are reduced before the acquired 
data from a volume of interest are projected onto an im- 
age plane. A master controller performs an algorithm 
that iteratrvely morphologically filters (28) the pixel data 
in a volume of interest and then iteratrvely projects 
(30,32,34) the morphologically filtered data onto a plu- 
rality of rotated image planes using a ray-casting tech- 
nique. Morphological filtering is performed by stepping 
a seven-point kernel through a source data volume of 
pixel data. The kernel, made up of a central pixel value 
and the six pixel values adjacent to the central pixel val- 
ue, is stepped through the entire source data volume. 
The morphological filtering operation includes at least 
one erosion step : which removes speckle, followed by 
an equal number of dilation steps, which restore the im- 
aging data. 
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D script ion 

[0001] This invention generally relates to imaging of 
the human anatomy for the purpose of medical diagno- 
sis. In particular, the invention relates to methods and 
apparatus for three-dimensional imaging of blood ves- 
sels in the human body by detecting intensity of ultra- 
sonic echoes reflected from the vessel. 
[0002] The most common modes of diagnostic ultra- 
sound imaging include B- and M-modes (used to image 
internal, physical structure), Doppler, and color flow (the 
latter two primarily used to image flow characteristics, 
such as in blood vessels). In conventional B-mode im- 
aging, ultrasound scanners create images in which the 
brightness of a pixel is based on intensity of the echo 
return, i.e., the amplitude of the reflected waves is em- 
ployed to produce black and white images of the tissues. 
[0003]- -Two-dimensional ultrasound images are often 
hard to interpret due to inability of the observer to visu- 
alize the two-dimensional representation of the anatomy 
being scanned. However, if the ultrasound probe is 
swept over an area of interest and two-dimensional im- 
ages are accumulated to form a three-dimensional vol- 
ume, the anatomy becomes much easier to visualize for 
both the trained and untrained observer. 
[0004] B-mode ultrasound imaging suffers from the 
inherent imaging artifact referred to as speckle. Speckle 
is the mottling found in the images produced from inter- 
ference patterns of multiple receive echoes. This mot- 
tling is primarily caused by nulls in the acoustic interfer- 
ence pattern, but other anomalies in the image, e.g., 
random electronic noise, can cause mottling. The 
acoustic nulls are accentuated by the loo, compression 
required to display the full dynamic range of the ultra- 
sound image. These nulls appear as black holes in the 
image. Speckle noise and artifacts limit the range of ac- 
ceptable view angles in three-dimensional ultrasound 
imaging. 

[0005] Since any parameter which changes the sum 
of the returning echoes will alter the speckle pattern, a 
number of conventional methods exist for reducing the 
speckle image artifact. Examples of such conventional 
methods include multiple transmit focusing, spatial com- 
pounding, frequency compounding and spatial low-pass 
filtering. The multiple transmit focusing, spatial com- 
pounding and frequency compounding techniques suf- 
fer from reduced frame rates, whereas spatial low-pass 
filtering has reduced resolution. 
[0006] In a preferred embodiment of the invention, 
speckle artifact data in three-dimensional ultrasound im- 
aging are reduced before the acquired data from a vol- 
ume of inter st are projected onto an image plan . The 
apparatus for achieving this result comprises an ultra- 
sound scanner which collects B-mod and/or color flow 
mode images in a cine memory on a continuous basis 
or in response to an external trigger event, i.e. .for a mul- 
tiplicity of slices. The data from a respective region of 
interest for each slice are sent to a master controller, 



such data forming a volume of interest. The master con- 
troller performs an algorithm that iteratively morpholog- 
ically filters the pixel data in the volume of interest and 
then iteratively projects the morphologically filtered data 
s onto a plurality o1 rotated image planes using a ray-cast- 
ing technique. 

[0007] In accordance with a preferred embodiment of 
the invention, the master controller smooths the speckle 
and/or noise contained in the pixel data by morpholog- 

10 ical filtering. This filtering is performed by stepping a 
seven-point kernel through a source data volume of pix- 
el data. The kernel is comprised of a central pixel value 
and the six pixel values adjacent to the central pixel val- 
ue, i.e., the respective pairs of adjacent pixel values in 

is the X, Y and 2 directions. The kernel is stepped through 
the entire source data volume, generating morphologi- 
cal filter output values which form a new source data 

volume having reduced speckle 

[0008] The algorithm for performing morphological fil- 

20 tering in accordance with the invention comprises n ero- 
sion operations followed by n dilation operations, where 
n is any positive integer. In a preferred embodiment, n 
= 3. 

[0009] The morphologically filtered pixel data volume 
25 is then projected onto each successive image plane. 
The projected images, having reduced speckle and 
noise, are stored as separate frames in the cine mem- 
ory, each frame being superimposed on the last back- 
ground frame. These reconstructed frames are then dis- 
30 played selectively by the system operator. The images 
clearly show any blood vessels in the object volume. 
When shown in the cine mode, the vessels rotate and 
a greater sense of depth perception is obtained as com- 
pared to that achieved by imaging a two-dimensional 
35 slice. 

[001 0] An embodiment of the invention will now be de- 
scribed, way of example, with reference to the accom- 
panying drawings, in which: 

[0011] FIG. 1 is a block diagram showing the major 
40 functional subsystems within a real-time ultrasound im- 
aging system. 

[0012] FIG. 2 is a block diagram showing the means 
for reconstructing frames comprising successive volu- 
metric projections of morphologically filtered intensity 
45 pixel data in accordance with a preferred embodiment 
of the invention. 

[0013] FIG. 3 is a flowchart showing the steps of an 
algorithm tor reconstructing frames comprising succes- 
sive volumetric projections of morphologically filtered in- 
so tensity pixel data in accordance with a preferred embod- 
iment of the invention. 

[0014] FIG. 4 is a schematic illustration of the sampled 
object volume of interest, an associated data volume 
and an image projection plane involved in volumetrically 
ss rendering a reversed ray-cast projection in accordance 
with the prior art. 

[0015] FIG. 5 is a schematic illustration showing a pair 
of geometric two-dimensional configurations corre- 
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sponding to like views of object and data volumes, and 
useful in defining necessary scaling constants in three- 
dimensional ultrasound imaging. 
[0016] FIG. 6 is a block diagram of means for provid- 
ing a maximum intensity projection in three-dimensional 
ultrasound imaging. 

[0017] The present invention may be incorporated in 
an ultrasound imaging system of the type generally de- 
picted in FIG. 1. The individual elements of an ultra- 
sound transducer array 2 are activated by a beamformer 
4 to transmit wavelets which are focused at the same 
transmit focal position with the same transmit charac- 
teristics to form a transmit beam. Each transmit beam 
propagates through the object being scanned and is re- 
flected back to the array by ultrasound scatterers in the 
object. After each transmit firing, the echo signals de- 
tected by the transducer array elements are fed to re- 
-speetivereeeiveehannel&of beamformer- 4rThereceive- 
beamformer tracks echoes under the direction of a mas- 
ter controller (not shown in FIG. 1). The receive beam- 
former imparts the proper receive focus time delays to 
the received echo signals and sums these signals to 
provide an RF (radio frequency) echo signal which ac- 
curately represents the total ultrasonic energy reflected 
from a succession of ranges corresponding to a partic- 
ular transmit focal zone. In a baseband system, the 
beamformer also transforms the RF echo signal into its 
l/Q components by means of Hilbert bandpass filtering. 
The //Ocomponents are then summed in a receive sum- 
mer (not shown) for each transmit firing. Hilbert band- 
pass filtering can alternatively be performed after beam 
summation. Optionally, the output signal of beamformer 
4 is shifted in frequency by a demodulator (not shown). 
One way of achieving this is to multiply the input signal 
by a complex sinusoidal e 2 */*", where / d is the frequen- 
cy shift required. 

[001 8] In a baseband system, the ^Ocomponents are 
sent to a B-mode processor 6, which incorporates an 
envelope detector 8 for forming the envelope of the 
beamsummed receive signal by computing the quantity 
Q 2 ) 1 ' 2 . The envelope of the signal undergoes some 
additional B-mode processing, such as logarithmic com- 
pression 10, to form display data which are provided to 
a scan converter 12. In an RF system, envelope detec- 
tion is performed on the RF signal. 
[0019] In general, the display data are converted by 
scan converter 12 into X— Y format for video display. 
The scan-converted frames are passed to a video proc- 
essor 14, which maps the video data to a gray scale or 
mapping for video display. The gray scale image frames 
are then sent to a video monitor 16 for display. 
[0020] The images displayed by video monitor 1 6 are 
produced from an image frame of data in which each 
datum indicates th intensity or brightness of a respec- 
tive pixel in the display. An image frame may, .g., com- 
prise a 256 x 56 data array in which each intensity datum 
is an 8-bit binary number that indicates pixel brightness. 
The brightness of each pixel on the display monitor 16 



is continuously refreshed by reading the value of its cor- 
responding element in the data array in a well-known 
manner. Each pixel has an intensity value which is a 
function of the backscatter cross section of a respective 
s sample volume in response to interrogating ultrasonic 
pulses and the gray map employed. A conventional ul- 
trasound imaging system typically employs a variety of 
gray maps, which are simple transfer functions of the 
raw acoustic sample data to display gray values. 

io [0021] As shown in FIG. 2, system control is centered 
in a host computer or master controller 22, which ac- 
cepts operator inputs through an operator interface (not 
shown) and in turn controls the various subsystems. 
Master controller 22 also generates the system timing 

is and control signals which are distributed via a system 
control bus 46 and a scan control bus (not shown). 
[0022] The scan converter 1 2 comprises an acoustic 

linememon/_iaand.an-X>Cdisplay.memory20. Acoustic_, 

line memory 18 accepts processed digital data from the 

20 B-mode processor and performs the coordinate trans- 
formation of the B-mode data from polar coordinate 
(R — 0) sector format or Cartesian coordinate linear ar- 
ray to appropriately scaled Cartesian coordinate display 
pixel data stored in XY display memory 20. In the B- 

25 mode, intensity data are stored in XY display memory 
20, each address storing three 8-bit pixels. Video proc- 
essor 14 multiplexes between graphics data, image da- 
ta, and timeline data to generate the final video output 
signal in a raster scan format on video monitor 16 and, 

30 additionally, provides for various grayscale maps. 
[0023] A multiplicity of successive frames of B-mode 
data are stored in a cine memory 24 on a first-in, first 
out basis. Cine memory 24 operates like a circular im- 
age buffer that runs in the background, continually cap- 

35 turing image data that are displayed in real time to the 
user. When the user freezes the system, the user has 
the capability to view image data previously captured in 
cine memory. The cine memory provides resident digital 
image storage for single image review and multiple im- 

40 age loop review and various control functions. The re- 
gion of interest displayed during single-image cine re- 
play is that used during acquisition of the image. Cine 
memory 24 also acts as a buffer for transfer of images 
to digital archival devices via master controller 22. 

45 [0024] Master controller 22 comprises a central 
processing unit (CPU) 42 and a random access memory 
44..CPU 42 has read only memory incorporated therein 
for storing routines used in transforming the acquired 
volume of intensity data into a multiplicity of three-di- 

50 mensional projection images taken at different angles. 
CPU 42 controls XY memory 20 and cine memory' 24 
via system control bus 46. In particular CPU 42 controls 
the flow of pixel data from XY memory 20 to video proc- 
essor 14 and to cine memory 24, and from the cine 

55 memory to the video processor and to the CPU itself. 
Each frame of intensity data, representing one of a mul- 
tiplicity of parallel scans or slices through the object be- 
ing examined, is stored in XY memory 20 and in the next 
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cycle is transmitted to video processor 14 and to cine 
memory 24. A stack ot frames, representing the 
scanned object volume, is stored in section 24A of cine 
memory 24. During initialization (see step 26 in FIG. 3), 
CPU 42 retrieves from cine memory section 24A only * 
the intensity data corresponding to an object volume of 
interest. This is accomplished by retrieving only the in- 
tensity data in a region of interest from each stored 
frame acquired from any scan which intersected the ob- 
ject volume of interest. Thus the intensity data corre- io 
sponding to the region of interest from each one of a 
stack of successive frames forms a source data volume 
of interest. 

[0025] The source data volume, schematically depict- 
ed in FIG. 4, is generated by scanning an object volume is 
52 with an ultrasound transducer. Object volume 52 is 
scanned in such a manner as to create a series of 

— staeKedTTOntrg^ori^ 

each of which contains the same number of object vol- 
ume elements (voxels) OV Each voxel has a rectangu- 20 
lar profile in the sheet plane (say, the X-Y plane); while 
the complementary sides may be of equal length S, so 
that this profile may be square, the sheet thickness Tis 
generally not equal to the length of either side. Thus the 
first object slice OSj contains a first multiplicity of object 2S 
voxels OV /V> where / and j are the respective X-axis 
and Y-axis positions of the voxel. Similarly, the second 
object slice OS 2 contains object voxels OV,^ 2 . An arbi- 
trary object slice OS^ contains voxels OV^ where k \s 
the Z-axis position of that voxel. Each object voxel OV^ 30 
is analyzed and the data value (intensity, velocity or 
power) thereof is placed in a corresponding data voxel 
DVjjf of a data volume 54. Data volume 54 is a simple 
cubic ij,k lattice, even though the thickness of each ob- 
ject slice OSfc and each object voxel face size (the size 35 
of the voxel in the X-Y plane) will generally not be the 
same. That is, not only may the object volume have dif- 
ferent X Y and Z dimensions for each voxel, but also 
the total number of voxels in any dimension need not be 
the same. For example, a typical ultrasound three-di- *o 
mensional scan may provide each slice with a 256 x256 
matrix of voxels, and may involve 128 slices. 
[0026] As seen in FIG. 3, the intensity data in the pixel 
data set corresponding to the object volume of interest 
are morphologically filtered (step 28) prior to projection 
in order to smooth speckle noise and reduce artifacts. 
This prevents loss of data due to speckle noise during 
projection. For example, blood vessels are less echo- 
genic than the surrounding tissue. Therefore, vessels 
can be imaged using minimum intensity projections. AI- 50 
ternatively, in the reverse video/minimum mode, the in- 
tensity data are inverted to make the vessels bright in- 
stead ot dark. The vessels can then be imaged using 
maximum intensity projections. To prevent selection of 
maximum intensities which are bright speckle as op- 55 
posed to desired pixel data, a filter can be used to re- 
move such bright speckle intensities prior to projection. 
Both morphological filtering and projection are prefera- 



bly performed by the master controller, but could also 
be performed by respective dedicated processors. 
[0027] In accordance with a preferred embodiment of 
the invention, the source data volume is filtered by CPU 
42 (FIG. 2) using a morphological filter which operates 
on a kernel comprised of a central pixel value in the 
source data volume and the six pixel values adjacent to 
the central pixel value. The kernel is stepped through 
the entire source data volume, generating morphologi- 
cal filter output values which form a new source data 
volume having reduced speckle. The algorithm for per- 
forming morphological filtering in accordance with the 
invention comprises n erosion operations followed by n 
dilation operations, where n is any positive integer. In 
the preferred embodiment, n= 3. If the central pixel val- 
ue of the kernel is designated DV^ the adjacent pixel 
values in the ±X directions are designated DV^ Jk and 
Qy f ^Fespectivetyrthe-adjacent pixeLvaiuesJn _tha±Y_ 
directions are designated DV^ 1j/f and DV^ respec- 
tively, and the adjacent pixel values in the ±Z directions 
are designated DV V>1 and DV v> i respectively, the 
erosion operation comprises the following steps. For 
each kernel, the processor determines the relative am- 
plitudes of the central pixel value DV^and the two pixel 
values DV M 4* and DV H Jtk along the X axis. There are 
four posstoilities: (1) DV^ 1J>r < DV, M < DV M ^ (2) 
DV hUk > DV^ > DV Mjr > (3) DV MJJC < DV^ > 

Wnjji W DV *U* > DV v.a < D W De P endin 9 00 
which possibility applies, the processor then computes 
the gradient G K For possibility 1, G x = DV M ^- DV tfi< ; 
for possibility 2, G x = DV^- DV M ^ for possibility 3, 
. O x = [(DV Mi *- V^p + (DV tfjr DV M ^)2p; and for 
possibility 4, G X = Q. The foregoing steps are repeated 
for the Y and Z directions. For the Y direction, the proc- 
essor determines the relative amplitudes of the central 
pixel value DV^and the two pixel values DV^^and 

DV f>1 h tnere are tour POSS ibi,itles: 0) DV />1 * K 
DV/j* < DV^^ (2) DVfw > DVa* > DV^j* (3) 
DV /Jf1Jt < DV IJJc > DV,^ (4) DV />U > DV W < 
DV />1 k Depending on which possibility applies, the 
processor then computes the gradient G y For possibility 
1 , G y = DV^ k - DV ;J for possibility 2, G y = D\f iJJ( - 
DV;^ ^ for possibility' 3, G y = [(DV^ 1?/f - DV^ 2 + 
(DV/jjr DVyj.! ^ a J 1/2 ; and for possibility 4, G y = 0. For 
the Z direction, the processor determines the relative 
amplitudes of the central pixel value DVjj k and the two 
pixel values DV, v/f+1 and DV /JJM . Again there are four 
possibilities: (1) DV,^ < DV iJk < DV yJ>1 ; (2) DV /J>+1 
> DV^> DV^jm; (3) DVyM < DV U *> DV /t/>1 ; (4) 
DV /J>+1 > D\f iJk < DVy >v Depending on which case 
applies, the processor then computes the gradient G z 
as follows: For possibility 1 , G z = DV/^ +1 - DV^ for 
possibility 2, G 2 = DV, V ,*- DV,^; for possibility 3, G r = 
KPVum - DV /V> )2 + (DV^- WujhW* and for pos- 
sibility 4, G 2 = 0. The processor then computes the 
quantity: 
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The quantity G'is then subtracted from pixel value DV,-^ 
to form a new pixel value DV,y k . When all values in the 
source data volume (stored in a first buffer memory) 
have been eroded in the foregoing manner, the resulting 
values torn) a once-eroded data volume which is stored 
in a second buffer memory within the master controller. 
Although the invention is broad enough to cover the sit- 
uation where speckle is removed from the source data 
volume using only one erosion (and only one dilation), 
in accordance with a preferred embodiment the source 
data volume is eroded three times, i.e., the once-eroded 
data volume is eroded to form a twice-eroded data vol- 
ume, which can be stored in the first buffer memory (or 
—a-third-buffer-memory).-The twice-eroded-data-volume- 
is in turn eroded to form a thrice-eroded data volume (e. 
g., stored in the second buffer memory). 
[0028] Afterthe desired number of erosions, the mas- 
ter controller performs an equal number of dilation 
steps. The dilation operation will be described using the 
same data value designations as those used in the dis- 
cussion of erosion, with the understanding that the data 
values dilated in the first dilation are those from the 
thrice-eroded data volume rather than the data values 
from the source data volume. For each dilation, the proc- 
essor steps the kernel of seven pixel values through the 
data volume. For each kernel, the process determines 
the relative amplitudes of a central pixel value DV,y k and 
the two pixel values D\f M j k and DV A1 j k along the X 
axis. Again there are four possibilities: (1) DV /VfJ/f < 
VV u . k < DV M ,> (2) QV UUk > DV V> > DV M ^' (3) 
W» U k < DV /V> > DV, U * (4) DV^ U * > QV Uk < 
DV Mj> Depending on which possibility applies, the 
processor then computes the gradient G x as follows: for 
possibility 1, G x - DV iJk - DV^^ for possibility 2, G x = 
DV *1 j k ' DV /j *i * or possibility 3, G x = 0; and for possi- 
bility^' G x =[(DV MJjr DV ; ^2 + (QV iJtk -DV hUk )^* 
The foregoing steps are repeated for the Y and Z direc- 
tions. For the Y direction, the processor determines the 
relative amplitudes of the central pixel value DV^ and 
the two pixel values DV^^and DV^^and then com- 
putes the gradient G r For the 2 direction, the processor 
determines the relative amplitudes of the central pixel 
value DVj^k and the two pixel values DV /j/f+1 and 
DV /j^-i and lhen com putes * he gradient G r The proc- 
essor again computes the quantity G'. Unlike erosion, 
where the quantity G'was subtracted from the pixel val- 
ue DV,y fordilation, G is added to the pixel value DV^ 
to form the new pixel value DV^'. When all values in 
the thrice-eroded data volume (retrieved from the sec- 
ond buffer memory) have been dilated in the foregoing 
manner, the resulting values form a once-dilated data 
volume which is stored in the first buffer memory. The 
once-dilated data volum is then dilated in the foregoing 
manner to form a twice-dilated data volume, which can 



be stored in the second buffer memory. The twice-dilat- 
ed data volume is in turn dilated to form a thrice-dilated 
(i.e., morphologically filtered) data volume (e.g., stored 
in the first buffer memory). This morphologically filtered 
5 data volume has reduced speckle. 

[0029] Following morphological filtering, CPU 42 
(FIG. 2) performs a series of transformations on the mor- 
phologically filtered data volume using the ray casting 
algorithm disclosed in U.S. Patent No. 5,226,113, is- 
10 sued Ju ly 6, 1 993 and assigned to the instant assignee. 
The successive transformations represent maximum, 
minimum or averaged intensity, velocity or power pro- 
jections made at angular increments, e.g., at 10° inter- 
vals, within a range of angles, e.g., +90° to -90°. How- 

15 ever, the angular increment need not be 10°; nor is the 
invention limited to any particular range of angles. 
[0030] In accordance with the ray casting technique 

employed- in^ a_pcefeaed>embodime.nt^_voJumelcically 

rendered projection images of a sample 50 (see FIG. 4) 

20 are displayed from any arbitrary viewing angle, e.g., a 
spherical projection angle denoted by angle parameters 
(0,<(>), where 0 is the angle that an extension 58' of a 
viewing ray 58 makes upon the X-Y plane, and <(> is the 
angle of ray 58 with respect to extension 58', 

25 [0031] In particular, and as shown in FIG. 4, an image 
of object 50 is projected (step 34 in FIG. 3) by CPU 42 
(FIG. 2) toward the image plane 56 from a lattice point 
in data voxel DVy j fr For convenience, the lattice point 
may, for example, be the data voxel vertex closest to the 

30 data volume origin. The cast ray 62 leaves the data vol- 
ume 54 at a projection angle with spherical angular pa- 
rameters (a,p) transformed from the spherical angular 
parameters (8,<|>) at which the object volume 52 is 
viewed. These two angles are not the same, due to the 

35 geometric distortion caused by use of a cubic data vol- 
ume 54 with a non-cubic object volume 52. However, 
the projected ray 62 has an x-y plane extension 62' 
which makes an angle a with respect to the axis of the 
data volume, and makes an angle p with the Z axis. 

40 Thus, angles a and p are determined by a rotation proc- 
ess (to be discussed hereinbelow) to correspond to 
viewing the object volume 52 at the desired viewing an- 
gle (8,((>) (assuming operation in spherical coordinates). 
Each of rays 62 is cast from the data volume voxel lattice 

45 point toward the image plane. 

[0032] While all rays 62 impinge upon some portion 
of the image plane, only those rays falling within the im- 
age plane pixel 60a under consideration are allowed to 
contribute to the data for that image plane pixel. Thus, 

50 having chosen a portion of the object volume 52 to view 
and a viewing angle (9,<|>) at which to view this selected 
object volume, the data value in each voxel of the cor- 
responding portion of the data volume is cast at some 
angle (a, P) (corresponding to viewing the distorted data 

55 volume with respect to the object volume) toward the 
image plane 56. The data value in a first voxel (say, vox- 
el DV /1Jt ) is thus back-projected along ray 62a, in ac- 
cordance with the 8 and $ values chosen. This ray 62a 
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Imping s upon image plane 56 at a position 64a within 
pixel 60a, and, as this is the first ray to impinge upon 
this pixel, the intensity, velocity or power value of the 
incident data is attributed to (stored in) the desired pixel 
60a. The next voxel in the data volume (say voxel 
DV, 2 k ) has its associated ray 62b projected at the same 
angular (a,P) configuration from the voxel lattice point 
to position 64b upon image plane 56. Assuming that im- 
pingement position 64b is within desired pixel 60a, the 
second projected value is (for a maximum pixel projec- 
tion) compared with the now stored first value, and the 
larger value is placed in storage for pixel 60a. For an 
averaged-value projection, the value of a current pro- 
jected data voxel is added to the sum already stored for 
the image panel pixel upon which that projection ray im- 
pinges, and the sum is eventually divided by a counted 
number of such impinging rays for that pixel. As each 
- -voxetimherselected datavolumeis^equentially^entered— 
and projected toward image plane 56, a data volume 
voxel (say, voxel DV /3;fc ) is eventually projected along 
its associated ray 62p and does not impinge within the 
desired pixel 60a, so that its data value (e.g., intensity) 
is not compared to the data value presently stored for 
pixel 60a. The maximum data value for pixel 60a is now 
established, for that projection of the data at the partic- 
ular (0,<|>) three-dimensional angle of view. However, ray 
62p does, in fact, have an impingement point 64p which 
falls within another image plane pixel (say, pixel 60b) 
and is compared to the data value stored therein, and 
the larger value is, after the comparison, returned to 
storage for that pixel. All data values are reset to zero 
when a new projection is to be taken. Thus, each of the 
image plane pixels is reset at the start of an image pro- 
jection procedure, and all of the data volume voxels (in 
the entire space or in the selected portion, as set by the 
portion of object volume 52 selected) are individually 
and sequentially scanned. The data value in each data 
voxel DV is projected through an associated ray 62 to 
impinge upon image plane 56 in one pixel 60a thereof, 
with the maximum value in each pixel being compared 
against the present value of the ray-casted data volume 
voxel to determine the larger thereof, which larger value 
is then stored as part of the maximum value image. In 
practice, for a maximum pixel projection, the stored 
maximum value will be changed only it the newly cast 
data voxel value is greater than the data value already 
stored for the image plane pixel upon which the newly 
cast ray impinges. 

[0033] In accordance with another aspect of the fore- 
going technique, the data projection is scaled (step 36 
in FIG. 3) andanyanisotropy betw en the object volume 
and th image plane is removed by only a single set of 
calculations after back projection is complete. Because 
object volume 52 is a real volume while data volume 54 
is an abstract concept, it is necessary to determine the 
amount of distortion of the data projection due to the 
presentation of the cubic data volum lattice 54 at a dif- 
ferent angle y, in a first plane, as shown in FIG. 5, which 



is different than the angle y at which an arbitrary viewing 
direction 66 will be positioned with respect to both the 
object volume 52 and data volume 54. The apparent di- 
mensions of each voxel will change as the effective el- 

5 ovation angles \j/ and ychange. If the aspect ratio A (de- 
fined as the ratio of the actual slice thickness T in object 
volume 52 to the actual pixel size S in the same object 
volume 52) is not unity (i.e. t is greater or less than unity, 
as the object voxel is not a cubic voxel, as will be en- 

10 countered in data volume 54), then the angles of eleva- 
tion \|/ and y will be different, and the effective elevation 
angle y in the data volume will be different than the ac- 
tual elevation angle y in the object volume. Rotation of 
the data is in accordance with an object elevation angle 

is obtained by: 



20 ^ = tan^tan[ r ]j . 

Thereafter, the projected data can be scaled to have the 
correct height (if rotation is about the horizontal axis) in, 
2S the object volume by multiplication of all projected data 
heights by the elevation scale factor. The old projected 
image height Hcan be corrected with an effective scale 
factor where 



30 I ~ T2 

E $ = *J(Acosy) 2 +sin y 

and the new height H'= H^E^ The same is true for the 
width when rotation is about the vertical axis. 

55 [0034] Utilizing the above relationship, the rotation of 
data volume angles (a,P) becomes angles (0,<t>), respec- 
tively, because the distortion is only along one axis, so 
that angle 0 equals angle a. The elements of the 3x3 
rotational matrix [M] can be determined, and given the 

40 two involved rotational angles, these relationships are 
used to determine the data volume-to-image plane 
transformations: 

X'= M^X+M2Y+ M3Z + XO 



Y'=M4X+M5Y+M6Z+ YO 

so where M1 -M6 are the first two rows of the rotational ma- 
trix (i.e., M1 = -sin 0, M2 = cos 0 sin y, M3 = 0, M4 = 
-cos 0 sin y2, M5 = -sin 0 sin y, and M6 = cos X" and 
Y' ar th locations on the image plane of the projected 
point, and XO and YOare image plane X and Y offsets 

55 (respectively referenced to the X and Y lowest value 
points) at which the selected portion of the image plane 
begins. After the data are projected onto image plane 
56, the image is scaled to correct for the effect of the 
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anisotropic object voxels. It will be seen that factors 
M1-M6 can be precalculated (step 32 in FIG. 3) at the 
beginning of a projection (given 0 and (j>) and used for 
all rotation calculations. 

[0035] FIG. 6 shows means for performing the above- 
described ray-casting technique which are incorporated 
in master controller 22 (FIG. 2) or a separate dedicated 
processor. Such means comprise a three-dimensional 
data memory 70 for storing slice data as received at a 
data input 70a from cine memory 24 (FIG. 2). The data 
associated with each object voxel are stored at the ad- 
dress of that voxel, responsive to voxel address input 
information received at a voxel address input 70b from 
a CPU 74. Once the data memory is filled (correspond- 
ing to the transfer of all required data from, as shown in 
FIG. 4, object volume 52 to data volume 54), the object 
volume portion of interest is selected and data estab- 
— lishing its starting- corner- and-extent in the-X-r-V-and Z 
directions is sent from CPU 74 to an input 72a of an ad- 
dress generator 72. The address sequentially provides, 
at an address output 72b, the X,Y,Z addresses of each 
voxel within the object volume selected. Output 72b is 
coupled to an output-data-address input 70c of data 
memory 70, causing the stored intensity data for that 
one voxel then addressed to be provided from data 
memory output 70d. The sequence of voxel X,Y,Z ad- 
dresses is also provided to a first input 76a of a rotational 
parameter calculator 76, which receives angle (a,P) in- 
formation via CPU 74 as the calculated matrix element 
M1-M6 values, to provide at an output 76c the address 
X'.Y' of the image plane pixel corresponding to that ob- 
ject X, YZ pixel when viewed at a selected viewing angle 
(8,(|>). The viewing angle (0,<|)) information is entered into 
the system and processed by CPU 74. The results are 
entered into inputs 78b and 78c of a viewing matrix 
means 78, to provide matrix elements M1-M6 at its out- 
put 78a and then to rotational parameter calculator 76. 
The image plane pixel address X'.Y' appears at an ad- 
dress input 80a of a frame buffer acting as an image 
plane memory 80. Simultaneously, the intensity data, 
projected from the data volume to the projection plane, 
appears at the image plane memory new data input 80b, 
from three-dimensional data memory output 70d. These 
data also appear at the new data input 82a of a data 
comparator 82. Intensity data previously saved in image 
plane memory 80 for that address, at input 80a, appear 
at an old data output 80c, and thence at an old data input 
82b of comparator means 82. The old and new data at 
inputs 82b/82a, respectively, are compared in compa- 
rator 82 and an output 82c thereof is enabled to a se- 
lected logic condition (e.g., a high logic level) if the new 
data at input 82a have greater amplitude than the old 
data at input 82b. Output 82c is coupled to a substitute- 
control data input 80d of image plane memory 80, to 
cause the data stored at the address controlled by input 
80a to be changed to accept the new data at input 80b, 
if substitute-data control input 80d is at the selected log- 
ic level. Thus, the stored data are initially r set, as by a 



signal through a data/control port 80e (from CPU 74), 
and the data of greatest value ar stored for each image 
plane pixel location X'.Y' responsive to a comparison in- 
dicating that the new data exceed the value of the pre- 
5 viously stored old data. After all of the selected address- 
es have been sequentially scanned by address gener- 
ator 72, the data stored in image plane memory 80 are 
scaled in CPU 74, and the scaled image plane data can 
be withdrawn from memory 80 for display, permanent 

10 storage or similar purposes. 

[0036] In accordance with a further aspect of the in- 
vention, the scaled image plane data are mapped, prior 
to display, to achieve a desired brightness and contrast 
range (step 38 in FIG. 3). While reading in the region of 

is interest for the source frames on which the three-dimen- 
sional reconstruction is based, a histogram of the 
number of pixels with a given intensity is optionally cre- 

ated in master controller.22.. Alternative^ 

can be formed using the projected images. At the same 

20 time, the maximum pixel intensity is determined. The 
pixels in each bin are counted until a given percentage 
of the total number of pixels is reached. This bin number 
becomes the pixel threshold. A map is then created such 
that each pixel value is mapped to the desired bright- 

25 ness and contrast range above or below the pixel 
threshold, depending on the intended result. 
[0037] The pixels in the region of interest from each 
slice or frame stored in cine memory 24 (FIG. 1 ) are mor- 
phologically filtered by CPU 42 and then stored in mem* 

30 ory 44 (see FIG. 2). The region-of- interest pixels stored 
in the cine memory can be read therefrom and supplied 
to the morphological filter as successive pixels or as an 
array of pixels. 

[0038] The morphological filtering and projection 

35 techniques described above can be separately applied 
to B-mode intensity data and color flow velocity or power 
data for the data volume of interest retrieved from the 
cine memory. Each pixel in the projected image would 
include the intensity data and the velocity or power data 

40 derived by morphological filtering and projection onto a 
given image plane. In addition, when the cine memory 
is frozen by the operator, then as indicated in FIG 2, CPU 
42 optionally stores the last frame from XY memory 20 
at multiple successive addresses in section 24B of cine 

45 memory 24. The projected image data for the first pro- 
jected view angle is written into the first address in cine 
memory section 24B, so that the projected image data 
in a region of interest are superimppsed on the back- 
groundframe. This process is repeated for each angular 

50 increment until all projected images are stored in cine 
memory section 24B, each projected image frame being 
made up of a region of interest containing transformed . 
data and, optionally, a background perimeter surround- 
ing the region of interest and composed of background 

55 frame data not overwritten by regbn-of-interest trans- 
formed data. The background image makes it clearer 
where each displayed projection is viewed from. The op- 
erator can then select any one of the projected images 
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for display. In addition, the sequence of projected imag- 
es can be replayed on the display monitor to depict the 
object volume as if it were rotating in front of the viewer. 
[0039] In accordance with a preferred embodiment of 
the invention, the ultrasound imaging system has a plu- 
rality of different projection modes. For example, the 
projection may include maximum or minimum value pix- 
els. Alternatively, a mode useful in imaging blood ves- 
sels may be selected wherein the pixel data are inverted 
and then the maximum values are projected onto the 
image plane. In accordance with a further mode, the ray- 
casting technique can be employed to provide a surface 
rendering. 



Claims 

1; Arrimaging system;- comprising:- - 

a memory for storing a source data volume of 

source pixel values; 

a data processor programmed to: 

(a) morphologically filter said source data 
volume to form a morphologically filtered 
data volume having less speckle than said 
source data volume, and 

(b) project said morphologically filtered da- 
ta volume onto an image plane to form a 
projected data set representing a projected 
image; and 

a display monitor for displaying said projected 
image in the form of a multiplicity of pixels. 

2. The imaging system as defined in claim 1 , further 
comprising: 

an ultrasound transducer array including a mul- 
tiplicity of transducer elements; 
a beamformer coupled to said transducer ele- 
ments for pulsing said transducer elements 
during a series of transmit firings andfor acquir- 
ing a respective receive signal from said trans- 
ducer elements subsequent to each transmit 
firing; 

a signal processor programmed to form respec- 
tive image signals from the receive signals; and 
a scan converter for converting said image sig- 
nals into said source data volume of pixel val- 
ues and for providing said source data volume 
to said memory for storage ther in. 

3. The imaging system as defined in claim 1 , wherein 
the data processor is programmed to morphologi- 
cally filt r said source data in n erosion steps fol- 
lowed by n dilation steps, where n is a positive in- 
teger. 



4. The imaging system as defin d in claim 3, wherein 
n=3. 

5. The imaging system as defined in claim 3, wherein 
5 a first erosion step programmed in said data proc- 
essor comprises: 



(a) for each of first, second and third directions, 
determining the relative values of a central 

10 source pixel value and first and second source 

pixel values adjacent to said centra! source pix- 
el value, and computing first, second and third 
erosion gradients, respectively, each of said 
first, second and third erosion gradients being 

is a function of a difference between said central 
source pixel value and one of said first and sec- 
ond source pixel values for the respective di- 
rection; 

(b) computing an erosion quantity as a function 
20 of said first, second and third erosion gradients; 

and 

(c) subtracting said erosion quantity from said 
central source pixel value to form an eroded 
pixel value. 

25 

6. The imaging system as defined in claim 5, wherein 
a first dilation step programmed in said data proc- 
essor comprises: 

30 (a) for each of first, second and third directions, 

determining the relative values of a central 
eroded pixel value and first and second eroded 
pixel values adjacent to said central eroded pix- 
el value, and computing first, second and third 

35 dilation gradients, respectively, each of said 

first, second and third dilation gradients being 
a function of a difference between said central 
eroded pixel value and one of said first and sec- 
ond eroded pixel values for the respective di- 

40 rection; 

(b) computing a dilation quantity as a function 
of said first, second and third dilatbn gradients; 
and 

(c) adding said dilatbn quantity to said central 
45 eroded pixel value. 

7. The imaging system as defined in claim 6, wherein 
said first erosion gradient for said first erosion step 
comprises one of the following values: 

50 

(a) a first difference between said central 
source pixel value and said first source pixel 
value if said central sourc pixel value is great- 
er than said first source pix I valu and said 

55 second source pixel valu is greater than said 

central source pixel valu ; 

(b) a second difference between said central 
source pixel value and said second source pixel 
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value if said central source pixel value is great- 
er than said second source pixel value and said 
first source pixel value is greater than said cen- 
tral source pixel value; 

(c) the square root of the sum of the squares of 
said first and second differences if said central 
source pixel value is greater than said first and 
second source pixel values; and 

(d) zero if said central source pixel value is less 
than said first and second source pixel values. 

8. The imaging system as defined in claim 5, wherein 
said erosion quantity is a function of the square root 
of the sum ol the squares of said first, second and 
third erosbn gradients. 

9. The imaging system as defined in claim 7, wherein 
saidfirstdilatiorr gradient forsaicHirst dilation-step- 
comprises one of the following values: 

(a) a first difference between said central erod- 
ed pixel value and said first eroded pixel value 
if said central eroded pixel value is greater than 
said second eroded pixel value and said first 
eroded pixel value is greater than said central 
eroded pixel value; 

(b) a second difference between said central 
eroded pixel value and said second eroded pix- 
el value If said central eroded pixel value is 
greater than said first eroded pixel value and 
said second eroded pixel value is greater than 
said central eroded pixel value; 

(c) the square root of the sum of the squares of 
said first and second differences if said central 
eroded pixel value is less than said first and 
second eroded pixel values; and 

(d) zero if said central eroded pixel value is 
greater than said first and second eroded pixel 
values. 

10. The imaging system as defined in claim 6, wherein 
said dilation quantity is a function of the square root 
of the sum of the squares of said first, second and 
third dilation gradients. 

1 1. A system for three-dimensional imaging of an ultra- 
sound scattering medium in an object volume, com- 
prising: 

an ultrasound transducer array for transmitting 
ultrasound beams and detecting ultrasound 
echoes reflected in a scanning plane intersect- 
ing the object volume at a multiplicity of sample 
volumes in said scanning plane; 
means for acquiring pixel data derived at least 
in part from ultrasound echoes reflected by the 
scattering medium, each pixel datum of said 
data corresponding to a respective one of said 



multiplicity of sample volumes in said scanning 
plane; 

a memory for storing a respective frame of 
source pixel values for each of a multiplicity of 
s successive scanning planes, the respective 

frames of source pixel values forming a source 
data volume; 

a central processing unit including: 

10 a morphological filter for filtering said 

source data volume to form a morphologi- 
cally filtered data volume having less 
speckle than said source data volume, and 
a random access memory for projecting 

is said morphologically filtered data volume 

onto an image plane to form a projected da- 
ta set representing a projected image; 

a display monitor for displaying said projected 
20 image in the form of a multiplicity of pixels; and 

a video processor coupled to said display mon- 
itor for displaying said projected image on said 
display device. 

25 12. The system as defined in claim 11, wherein said 
morphological filter comprises: 

(a) means for determining the relative values of 
a central source pixel value and first and sec- 

30 ond source pixel values adjacent to said centra I 

source pixel value in a predetermined direction, 
and for computing an erosion gradient which is 
a function of a difference between said central 
source pixel value and one of said first and sec- 

35 ond source pixel values for said direction; 

(b) means for computing an erosbn quantity as 
a functbn of said erosion gradient; and 

(c) means for subtracting said erosion quantity 
from said central source pixel value to form an 

40 eroded pixel value. 

13. The system as defined in claim 12, wherein said 
morphological filter further comprises: 

45 (a) means for determining the relative values of 

a central eroded pixel value and first and sec- 
ond eroded pixel values adjacent to said central 
eroded pixel value in said direction, and for 
computing a dilation gradient which is a func- 

50 tion of a difference between said central eroded 

pixel value and one of said first and second 
eroded pixel valu s for said direction; 
(b) means for computing a dilation quantity as 
a function of said dilation gradient; and 

55 (c) means for adding said dilation quantity to 

said central eroded pixel value to form a mor- 
phologically filtered pixel value. 
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14. An imaging system, comprising: 

a memory for storing a source data volume of 

source pixel values; 

a central processing unit including: 

a morphological filter for filtering said 
source data volume to form a morphologi- 
cally filtered data volume having less 
speckle than said source data volume, and 
a random access memory for projecting 
said morphologically filtered data volume 
onto an image plane to form a projected da- 
ta set representing a projected image; 

a display monitor for displaying said projected 
image in the form of a multiplicity of pixels; and 

avicfeo processor coupledlo saiddisplay^mon=— 

itor for displaying said projected image on said 
display device. 

15. The imaging system as defined in claim 14, wherein 
said morphological filter comprises: 

(a) means for determining the relative values of 
a central source pixel value and first and sec- 
ond source pixel values adjacent to said central 
source pixel value in a predetermined direction, 
and for computing an erosion gradient which is 
a function of a difference between said central 
source pixel value and one of said first and sec- 
ond source pixel values for said direction; 

(b) means for computing an erosion quantity as 
a function of said erosion gradient; and 

(c) means for subtracting said erosion quantity 
from said central source pixel value to form an 
eroded pixel value. 

1 6. The imaging system as defined in claim 1 5, wherein 
said morphological filter further comprises: 

(a) means for determining the relative values of 
a central eroded pixel value and first and sec- 
ond eroded pixel values adjacent to said central 
eroded pixel value in said direction, and for 
computing a dilation gradient which is a func- 
tion o1 a difference between said central eroded 
pixel value and one of said first and second 
eroded pixel values for said direction; 

(b) means for computing a dilation quantity as 
a function of said dilation gradient; and 

(c) means for adding said dilation quantity to 
said central eroded pixel value to form a mor- 
phologically filtered pixel valu . 

17. The imaging system as defined in claim 14, further 
comprising: 



18 

an ultrasound transducer array including a mul- 
tiplicity of transducer elements; 
a beamformer coupled to said transducer ele- 
ments for pulsing said transducer elements 
during a series of transmit firings-and for acquir- 
ing a respective receive signal from said trans- 
ducer elements subsequent to each transmit 
firing; 

a signal processor programmed to form respec- 
tive image signals from the receive signals; and 
a scan converter for converting said image sig- 
nals into said source data volume of pixel val- 
ues and for providing said source data volume 
to said memory for storage therein. 

18. A method for three-dimensional imaging of an ultra- 
sound scattering medium in an object volume, com- 
prising the-following-stepst 

transmitting ultrasound beams in a scanning 
plane intersecting the object volume at a multi- 
plicity of sample volumes in said scanning 
plane; 

detecting ultrasound echoes reflected from 
said multiplicity of sample volumes in said 
scanning plane; 

scanning said scanning plane through the ob- 
ject volume; 

acquiring pixel data derived at least in part from 
ultrasound echoes reflected by the scattering 
medium, each pixel datum of said data corre- 
sponding to a respective one of said multiplicity 
of sample volumes; 

storing acquired pixel data for each of said mul- 
tiplicity of sample volumes to form a source da- 
ta volume; 

morphologiocally filtering said source data vol- 
ume to form a morphologically filtered data vol- 
ume having less speckle than said source data 
volume; 

projecting said morphologically filtered data 
volume onto an image plane to form a projected 
data set representing a projected image; and 
displaying said projected image. 

19. A method for three-dimensional imaging of matter 
in an object volume, comprising the steps of: 

acquiring a source data volume of source pixel 
values representing said matter in said object 
volume; 

morphologically filtering said source data vol- 
ume to form a morphologically filtered data vol- 
um having I ss speckle than said source data 
volume; 

projecting said morphologically filtered data 
volume onto an image plane to form a projected 
data set representing a projected image; and 
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displaying said projected image. 

20. The method as defined in claim 1 9, wherein the step 
of morphologically filtering comprises performing n 
erosion steps followed by n dilation steps, where n 
is a positive integer. 

21. The method as defined in claim 20, wherein n= 3. 

22. The method as defined in claim 20, wherein a first 
one of said erosion steps comprises: 

(a) for each of first, second and third directions, 
determining the relative values of a central 
source pixel value and first and second source 
pixel values adjacent to said central source pix- 
el value, and computing first, second and third 
erosion -gradientsr respectively^- each- of- said- 
first, second and third erosion gradients being 
a function of a difference between said central 
source pixel value and one of said first and sec- 
ond source pixel values for the respective di- 
rection; 

(b) computing an erosion quantity as a function 
of said first, second and third erosion gradients; 
and 

(c) subtracting said erosion quantity from said 
central source pixel value to form an eroded 
pixel value. 

23. The method as defined in claim 22, wherein a first 
one of said dilation steps comprises: 

(a) for each of first, second and third directions, 
determining the relative values of a central 
eroded pixel value and first and second eroded 
pixel values adjacent to said central eroded pix- 
el value, and computing first, second and third 
dilation gradients, respectively, each of said 
first, second and third dilation gradients being 
a function of a difference between said central 
eroded pixel value and one of said first and sec- 
ond eroded pixel values for the respective di- 
rection; 

(b) computing a dilation quantity as a function 
of said first, second and third dilation gradients; 
and 

(c) adding said dilation quantity to said central 
eroded pixel value. 

24. The method as defined in claim 23, wherein said 
first erosion gradient for said first erosion step com- 
prises one of the following values: 
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second source pixel valu is greater than said 
central source pixel value; 

(b) a second difference between said central 
source pixel value and said second source pixel 
value if said central source pixel value is great- 
er than said second source pixel value and said 
first source pixel value is greater than said cen- 
tral source pixel value; 

(c) the square root of the sum of the squares of 
said first and second differences if said central 
source pixel value is greater than said first and 
second source pixel values; and 

(d) zero if said central source pixel value is less 
than said first and second source pixel values. 

25. The method as defined in claim 22, wherein said 
erosion quantity is a function of the square root of 
the sum of the squares of said first r second and third - 
erosion gradients. 

26. The method as defined in claim 24, wherein said 
first dilation gradient for said first dilation step com- 
prises one of the following values: 

(a) a first difference between said central erod- 
ed pixel value and said first eroded pixel value 
if said central eroded pixel value is greater than 
said second eroded pixel value and said first 
eroded pixel value is greater than said central 
eroded pixel value; 

(b) a second difference between said central 
eroded pixel value and said second eroded pix- 
el value if said central eroded pixel value is 
greater than said first eroded pixel value and 
said second eroded pixel value is greater than 
said central eroded pixel value; 

(c) the square root of the sum of the squares of 
said first and second differences if said central 
eroded pixel value is less than said first and 
second eroded pixel values; and 

(d) zero if said central eroded pixel value is 
greater than said first and second eroded pixel 
values. 

27. The method as defined in claim 23, wherein said 
dilation quantity is a function of the square root of 
the sum of the squares of said first, second and third 
dilation gradienls. 



so 



(a) a first difference between said central £5 
source pixel value and said first source pixel 
value if said central source pixel value is great- 
er than said first source pixel value and said 
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